New Active-Set Frank-Wolfe Variants for Minimization over the Simplex and the L1- Ball

نویسندگان

  • Andrea Cristofari
  • Marianna De Santis
  • Stefano Lucidi
  • Francesco Rinaldi
  • A. Cristofari
  • M. De Santis
  • S. Lucidi
  • F. Rinaldi
چکیده

In this paper, we are concerned with minimization problems over the unit simplex. Here, we propose the use of an active-set estimate that enables us to define an algorithmic framework where the variables estimated active and those estimated non-active are updated separately at each iteration. In particular, we consider different variants of the Frank-Wolfe direction to be combined with the proposed active-set strategy, proving the convergence of the algorithm for each of them. Then, we focus on the problem of minimizing a function over the `1ball, showing how our algorithmic framework can be efficiently adapted to this problem. Preliminary numerical results show the benefits of the proposed active-set estimate.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

New Active-set Frank-wolfe Variants for Minimization over the Simplex and the `1-ball

In this paper, we describe a new active-set algorithmic framework for minimizing a function over the simplex. The method is quite general and encompasses different active-set Frank-Wolfe variants. In particular, we analyze convergence (when using Armijo line search in the calculation of the stepsize) for the active-set versions of standard Frank-Wolfe, away-step Frank-Wolfe and pairwise Frank-W...

متن کامل

Frank-Wolfe with Subsampling Oracle

We analyze two novel randomized variants of the Frank-Wolfe (FW) or conditional gradient algorithm. While classical FW algorithms require solving a linear minimization problem over the domain at each iteration, the proposedmethod only requires to solve a linear minimization problem over a small subset of the original domain. The first algorithm that we propose is a randomized variant of the ori...

متن کامل

Linear Convergence of a Frank-Wolfe Type Algorithm over Trace-Norm Balls

We propose a rank-k variant of the classical Frank-Wolfe algorithm to solve convex optimization over a trace-norm ball. Our algorithm replaces the top singular-vector computation (1-SVD) in Frank-Wolfe with a top-k singular-vector computation (k-SVD), which can be done by repeatedly applying 1-SVD k times. Our algorithm has a linear convergence rate when the objective function is smooth and str...

متن کامل

Private Empirical Risk Minimization Beyond the Worst Case: The Effect of the Constraint Set Geometry

Empirical Risk Minimization (ERM) is a standard technique in machine learning, where a model is selected by minimizing a loss function over constraint set. When the training dataset consists of private information, it is natural to use a differentially private ERM algorithm, and this problem has been the subject of a long line of work [CM08, KST12, JKT12, ST13a, DJW13, JT14, BST14, Ull14]. A pr...

متن کامل

Compressed Sensing via Iterative Support Detection

We present a new compressive sensing reconstruction method ISD, aiming to achieve fast reconstruction and a reduced requirement on the number of measurements compared to the classical l1 minimization approach. ISD addresses failed cases of l1–based construction due to insufficient measurements, in which the returned signals are not equal or even close to the true signals. ISD will learn from su...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2016